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We introduce a layered random spin model, equivalent to 
the Generalized Random Energy Model (GREM). In anal- 
ogy with diluted spin systems, a diluted GREM (DGREM) 
is introduced. It can be applied to calculate approximately 
thermodynamic properties of spin glass models in low dimen- 
sions. For Edwards -Anderson model it gives correct critical 
dimension and 5% accuracy for ground state energy in 2d. 

Derrida's Random Energy Model (REM) [1] was intro- 
duced as an archetype spin glass model. In recent years it 
is becoming more and more popular. It has been applied 
in many fields of physics, biology and even in information 
theory [2,3]. 

The REM is a mean-field model, like the Sherrington- 
Kirkpatrick model, but maximally simplified. But even 
after this simplification it appears to be a good approxi- 
mation of some real systems. 

The generalization of the REM (called Generalized 
Random Energy Model, GREM) was introduced in ref. 
[5]. It was used to solve approximately other spin glass 
systems [6,7]. Unfortunately, the accuracy to describe 
other SG systems was not much better than for the 
REM. In this work we introduce a diluted spin model 
which thermodynamically resembles GREM (in the case 
of large coordination number it is exactly equivalent 
to GREM), then construct some new model of energy 
configurations-DGREM. In some (practically important) 
cases our spin model is thermodynamically exactly equiv- 
alent to DGREM. There is another case of DGREM also, 
where we could not choose equivalent spin hamiltonian. 
Our new model is closer to realistic systems with a finite 
coordination number, than GREM. 

Even the simpler diluted REM (DREM) [8,9] has 
proven to be a good approximation for models in low di- 
mensions (d=l,2,3). This important fact was observed in 
[10], where by information-theoretical arguments (math- 
ematically leading to a DREM) a percolation threshold 
was found. 

We can estimate the ground state energy of the 
Edwards- Anderson model, using a DREM with the same 
number z of non-zero couplings [8,9]. It holds that on 
a hyper cubic lattice in rf-dimensions z = Nd, where N 
is the number of spins. For another lattices one should 
replace d by the half of coordination number. 

In the DREM one has N Ising spins interacting with 
each other in the z (randomly chosen from all the possi- 
ble Cfj = p I (/yip) I ) P-plets of Ising spins and quenched 
random couplings Ti^^-.-^ij, having values ±1. 

The Hamiltonian reads 
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At high temperatures the system is in the para mag- 
netic phase. There it has a free energy 
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where (3 = Below the critical temperature Tc — l/Pc 
the system freezes in a spin-glass phase with internal en- 
ergy 



— = — atanhpr 
N 



(3) 



and vanishing entropy 
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Here tanh/3c = f{d) involves a function f{x) defined by 
the implicit equation 

1(1 + /) ln(l + ./) + ^(1 - /) ln(l - /)] = ^ (4) 

Since the entropy is zero, we obtain for the ground 
state energy of the Edwards- Anderson model on a hyper 
cubic lattice in d dimensions 
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In 2d Esq. (5) gives E w —1.5599, which is close to result 
of Monte-Carlo simulation for the case of random ±1 
couplings [11] f = -1.4015 ± 0.0008. This estimate by 
formula (3) was done by Derrida in his original work [1], 
long before the introduction of the DREM in reference 
[8]. 

Let us now construct some spin model, which has prop- 
erties like the GREM. It is very important to have spin 
representation for GREM (for example- to construct tem- 
poral dynamics). 

We consider a stacked system consisting of M planes with 
spin ordered along a "vertical" axis. In plane (layer) 
k there are Nk spins. The Hamiltonian is a sum of M — 1 
terms Hk^k+i and one Hm- The last is as in eq. (1), with 
N — > Nm, z zm and all the interacting spins are from 
the M-th layer. For the 1 < fc < M — 1 term Hk^k+i de- 
scribes interaction between spins of neibor layers k and 
k + 1 through z^ p-plets of spins. In this case in any p- 
plet I spins are chosen from the layer k and | from the 
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layer (fc — 1). Our Zk p-plets are chosen randomly from 
the all possible [ p \ p.. i ]^ ones. There are no "intra- 

plane" interactions terms (besides the spins of layer M) 
but only "inter-plane" interactions. So spins in the layer 
1 < k < M interact with spins from the layers fc ± 1, the 
first layer interacts with the spins of second layer. We 
thus have the Hamiltonian 

n = - E r,,,..,,<...< (6) 

(l<<i,---<ip<iVM) 

M-1 Zk 

-E E 

fe=l (l<ii,---<ip <Arje_i,l<ji---<jp <Nk) 

Till now we considered spin model with some interaction 
among the spins. Let us now introduce some GREM like 
model. We consider some M level hierarchic tree. At 
first level there are 2^^ branches. At second level every 
old branch fractures to 2^^ new ones and so on. At the 
level M there are 2^ branches, where 

M 

N= =Ni (7) 

i=l,M 

Energy configurations of our system are located on the 
ends of Af-th level branches. On every branch of level i 
there are distributed random variables e, with the distri- 
bution 

f-ioo 

Po{^i,Zi) = TT^ dfcexp[-/;;ej + ^;jlncoshfc] (8) 

This is a distribution for a sum of Zk random ±1 vari- 
ables. So Zk resembles mimbcr of couplings in our di- 
luted spin models. With any energy configuration are 
connected M branches. We define configuration energy 
as a sum (along the path on the tree, connected with 
chosen energy configuration) of these M variables Cj. We 
see a usual picture of GREM, where random variable are 
distributed according to (7) instead of normal partition. 

We can consider the case of large M with smooth dis- 
tribution of Zk and Nk- In this case wc can introduce 
continues variable v = ^ between and 1, labeling the 
level of planes and define distributions 

Zk=dz = zdv, Nk = dN = n'{v)dv = (^) 

where n{v) is a given function (entropy in bits-s). The 
variable v { < v < 1) parameterizes the level of the 
hierarchical tree and zisa parameter (for our spin system 



z is a total number of couplings and parameter v labeling 
the level of planes). 

Of course, our function n{v) should be monotonic. Total 
number of energy configurations is 2"(°^ and 

n(0) = N (10) 

We have, that 2^ energy levels E of our hierarchic model 
are distributed by partition 

p{E)=po{E,z) (11) 

If two configurations (in our GREM like model) meet 
at level of hierarchy v, they have zv common random 
variables. The energy difi^erence between two configura- 
tions is related to z{l—v) non-common random variables. 
Therefore the distribution function of two energies Ei , E2 
reads 

P2{Ei - E2) = po{{Ei - £2), 22(1 - u))exp(ln2n(i;)) 

(12) 

At high temperatures our system is in the para mag- 
netic phase. The free energy is given by eq. (2). When 
we decrease the temperature, two situations are possible: 
First, ^ = -^pj:^ decreases monotonically with v; sec- 
ond, it has a local maxim. 

In the first case the system has no sharp phase transition 
but it freezes gradually. At temperature T = ^ all level 
with < V < Vf{T) are frozen; they are in the spin glass 
phase. The levels with Vf < v < 1 are in the param- 
agnetic phase. Vf is defined as the solution Vf = v of 
equation 

tanh/3 = /(^) (13) 

n'[v) 

Using this relationship between /3 and v we can later use 
functions v{(3) and /3{v). For every finite the value 
of f(/3) lies between zero and unity. When T ^ 00, 
v{P) and when T 0,v{P) vq > 0. So even in 
this limit some part of spins stay in their para magnetic 
phase. Let \is point out that this partial freezing only is 
possible in the Diluted GREM, and not in the original 
GREM. For the free energy we obtain ( there is no factor 
N in it): 

-f3F= ^(1 -t;(/J))lncosh/J + n(t;(/J))ln2 

The first two terms in the right hand side describes the 
para magnetic fraction of free energy (n(i'(/3)) In 2 just is 
the entropy), while the last one desrcibe the fraction of 
spins frozen in a glassy configuration (it resembles equa- 
tion (3) with j7^^ instead of d). 

In the second case (function n'{v) is not monotonic) the 
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system has a sharp first order phase transition at a finite 
temperature T2. Below T2 freezing occurs drastically for 
all levels v < V2, where V2 = v{p2) is defined by the 
equation 



z = Nd, e = E, v = 2y-l, n{v) = 



Ns{-vdN) 
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(20) 



n'{v2) = N - n{v2) 



(15) 



We used the fact that n(0) = N. The transition temper- 
ature To = J- follows from 

P2 



We see, that variable v, givimg distribution for the num- 
ber of couplings among the hierarchy corresponds to en- 
ergy per bond in ferromagnetic model. We can remember 
from definition of temperature 



tanh(/32) = /(- 
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For temperatures T < T2 the free energy reads 



(16) 
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At given /3i we can define corresponding vi as minus 
energy per bond for ferromagnetic model at temperature 



v{l3)) In cosh f3 + n{v{f3)) In 2 
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Nd 
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Protein folding probably corresponds to this case. To 
construct the spin Hamiltonian by means of chain of sub- 
systems for this case is still an open problem. 
Let us now consider a possible approximation to the 
Edwards- Anderson model, following the idea's presented 
in ref. [6]. In the d-dimensional case our 2^ energy levels 
E are distributed according to the law 



p{e)=po{e,Nd) 



(18) 



with po defined in eq. (8) Comparing with (11) one 
immediately notices that this is exactly equivalent to a 
DGREM with the choice E = e, z = Nd. Let us now con- 
sider the distribution of ci — Following the arguments 
presented in reference [6], we find that 

P2(ei - £2) = poC-^^,Nd{l - y)) expNs{-dN{2y - 1)) 

(19) 

where s{E) is the entropy of a ferromagnetic system on 
the same lattice with internal energy equal E. Physical 
meaning of the last equation is transparent [6]. If we 
consider partition of two spin configurations, then one of 
them could be chosen (due to gauge invariance) as or- 
dered configuration with ai = 1 for all spins. In this 
case energy of first configuration equals to sum of d,N 
random ± couplings and energy of second - sum of the 
Ndy random variables with the same sign, and Nd(l — y) 
with the opposite sign. Distribution of second config- 
urations by y just equals to number of configurations 
with energy E = —{2y — l)Nd in ferromagnetic model. 
For the last in thermodynamic limit we have expression 
cxpNs{—dN{2y — 1). Unfortunately it differs from eq. 
(12). So it is impossible to choose a DGREM with the 
given correlation functions for E and Ei — £2- We can 
consider an approximation. One choice is to take the ex- 
act expression for p{e) and make an approximation for 
p(ei - €2). 



We obtain for the free energy 

3F r^^'^ In 2 

-^ = (l-^^(/3))lncosh/3 + s(t;(/?))+/? dv,f{^) 



(23) 



Integrating by parts in the last term we get 



^ = (1 - vm In cosh /3 + s{vm -13 d/3i^^ 



+ v{l3)l3y{l3) 

where y as a function of P\ is defined from the equation 

(25) 



(24) 



function t;(/3) is defined from (13), and wi(/3i) is minus 
energy per bond in ferromagnetic model at temperature 
/3i. In the equation (24) value of the (3 is connected with 
the given /J via the equation 



tanh(/^)=/(i^) 
In the limit of zero temperature this reduces to 
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2 r'-^ dp,E0,) 

i-y(/3i) 



(26) 



(27) 



He E((3) = \U\ is minus the energy in the ferromagnetic 
model, y{l3) is defined from (25) and function f{x) from 
the (4). If the ferromagnetic system has a phase transi- 
tion at /3c, then the DGREM has one at (3c determined 

by 



(3c 



1 l + /(f^) 
-In 

2 !-/(¥) 



(28) 



3 



This equation has solution only if 



ln2//3c>l (29) 

As for 2d Ising model ln2 < /?c , it follows that for the 
2d Edwards-Anderson model there does not occur a 
phase transition at a finite temperature, is not 
any phase transition at finite temperatures. A calcula- 
tion of the ground state energy in this case using (27) 
gives E = —1.4763. More generally, for the case of other 
models one can use numerical data for the ferromagnetic 
system to calculate the ground state energy of the cor- 
responding SG model on the same lattice. 
In the case of 3d Ising model we have for transition point 
Pc = 0.2216. In this case inequality (29) is satisfied. 
So our method gives as critical dimension for EA model 
d = 3. 

In conclusion, we have suggested a a diluted version 
of the generalized random energy model and ap- 
plied to find a simple approximation to the ground state 
energy of disordered systems and definition of critical di- 
mensions. 
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